Graphic-information flow method and system for visually analyzing patterns and relationships

ABSTRACT

A novel display control and information management system seamlessly integrates layered and slotted formatted data from both local and remote sources to provide a highly versatile information display. The system permits selective control of display so that complex data and data flows can be seamlessly accessed with enhanced cognition of salient information by the User.

This is a CONTINUATION of application Ser. No. 09/359,544, filed Jul.22, 1999, now U.S. Pat. No. 6,307,573.

FIELD OF THE INVENTION

The invention generally relates to computer controlled graphic displaysystems. More specifically, the present invention provides systems andsoftware for organizing and configuring large, complex sets of graphicinformation for quick access and in-depth analytical study. Theinvention enables the integration of information from many sources forviewing in a layered and slotted, interactive map format.

BACKGROUND OF THE INVENTION

Throughout the ages, humans have devised ways to record, then examine,their thoughts and mental images on paper. People draw depictions ofevents, places, projects, and sets of objects. They chart scientificprocesses, demographics, weather conditions, and mechanical systems; andthey diagram organizations, trade routes, music, and inventions. Thesedrawings aid both the originator and subsequent audiences in picturingspatial or symbolic relationships. Paper drawings and maps arerepresentations of the real world; but often the viewer must struggle tosee only what is relevant amidst too much information. Transparentoverlays can separate graphic information, but are cumbersome andrestrictive. Reference documents such as catalogues, guide books,atlases, and encyclopedias gather together images and text descriptions;but the user must flip back and forth between pages to find, link, andcompare information.

Today, computers are now being used to generate, compile, and retrievesuch graphic records. However, they have not as yet enabled viewers tosmoothly call forth sets of graphic data to inform and stimulate asustained, multi-faceted, analytical thought process. For example,computer programs that employ graphics layering are currently used togenerate illustrations (computer graphics), drawings of designs (CADD),and searchable and thematic geographic maps (GIS).

Computer graphics can be used to draw lines and shapes which may beorganized into layers for overlapping and for showing and hiding beforebeing output as a printed or digital illustration. CADD (Computer-AidedDesign and Drafting) is used to create plans of products, vehicles,buildings, utility systems, and other three-dimensional objects. CADDemploys layering technology to draft and show different views of athree-dimensional object. A GIS (Geographic Information System) plotsdata on a map with layers of points, lines, and polygons representingland features. Each GIS feature has an entry in a database with itsname, a set of coordinates (which may be real-world latitude andlongitude) for positioning the feature on the screen, and attribute datawhich may be shown in a separate window and queried to determine a setof features to be displayed.

These graphics-making programs are used primarily by technicians toproduce a singular image for publication and, in limited ways, forinteractive analysis. However, non-technicians—the public, executives,and experts in non-computer fields—cannot use them to easily access andmanipulate selections of layered materials. Nor can they easily createor assemble their own sets of interactive, layered data.

GIS (Geographic Information Systems) has come furthest in addinginteractivity to computer-generated images. Drop-down menus, graphicstools, and palettes are used for customized map production; this slow,unwieldy process is of very limited use for multi-faceted analysis.Networked GIS is used within corporate and government intranets toprovide staff access to data displayed on geographic maps; it is alsoused on World Wide Web sites for the public to find a street address orthe location of one particular facility or type of facility (see“Serving Maps on the Internet,” by Christian Harder, 1998, EnvironmentalSystems Research Institute, Inc., Redlands, Calif., incorporated hereinby reference as if restated in full.) In addition to searching foraddresses and facilities, the interactive capabilities of current onlineGIS include zooming in and out and panning within a large digital mapfile.

A typical GIS often also has a large database with thematic informationfor places on the map. However, current GIS does not provide forseamless access to subset combinations from extensive data sets. Alegend, table of contents, or key shows a small selection of themes andthe symbols associated with subsets within each theme. In some cases,entire themes may be shown or hidden by clicking a check box next to thetheme title on the legend; however, a particular subset within a themecannot be shown or hidden. Current online GIS interfaces rely on thescrolling of palette scroll bars to extend the legend and to viewselections for queries; this scrolling breaks the flow of data selectionand severely limits the organization and amount of data that can beaccessed. Sometimes scrolling is also required to view the entire mapand each subsequent iteration, further breaking the flow of theanalytical thought process. Annotational information, when available, isprovided by going to a separate Web page or window; and thereby thematerial is not viewed smoothly, in direct association with the mapfeature.

Beyond layering software, another relevant computer technology ishypermedia. Hypermedia is the “linking” technology for instantlyretrieving text, images, or sounds. Its “smart” graphics respond tocommands such as mouse clicks to “hypertext” or to a “hot” symbol on thecomputer screen (often referred to as a button, object, icon, orimagemap).

From 1990 to 1993, the inventor developed a hypermedia map-makingsoftware program (“CityView/TownView HyperMapping—making maps and maplibraries on your computer. A Journal of Demonstration Projects” andsoftware manual, self-published, by Barbara L. Barros, Boston 1994,incorporated herein by reference). This program provided an interactivetutorial and tool with which novice computer-users could make their ownmap libraries for a study of their neighborhoods, cities, or towns. Thesoftware program used the first widely available hypermedia softwaredevelopment tools; APPLE COMPUTER INC.'s two-layered HYPERCARD. On thebackground layer of the map-making software was a base map either drawnby the user or imported as a scan or GIS-generated bitmap graphic. Theuser rendered sets of information on separate top layers using paint(raster or bitmap) graphics, text fields, and buttons which could linkto new maps, paint layers, and text. The overlays were automaticallyindexed in a directory from which users could select layers to combineon a new, aggregated map. However, the layers were then fused together,so the map could not be used to aid a flowing analytical thoughtprocess.

The primary intent of the “CityView/TownView” map-making software was toenable civil servants and citizens to engage in exercises through whichthey could improve their awareness of local planning issues andopportunities. The software had several significant limitations: (1) themap features were not objects and could not have data or scriptsattached to them, (2) map graphics could only be in black and whitewhich reduced legibility and appeal, (3) the software was dependent onAPPLE's MACINTOSH operating system having limited distribution, (4)users tended not to have or be able to afford base map data, and (5) thelarge amounts of graphic data generated could not be stored on mostpersonal computers or shared easily with others.

CD-ROMs and the World Wide Web are, at this time, the two predominantmeans of delivering hypermedia. For organizing and displaying material,these current hypermedia use GUI (graphical user-interface) formatswhich are derivative. They draw from a combination of print publicationequivalents, software document-creation conventions, and videopresentation methods.

CD-ROMs were the first major application of hypermedia because of thevast storage capability for graphics and sound. These files are linkedto create multi-dimensional games, training materials, and referencesources. Current reference CD-ROMS are organized to incrementally accessgraphic and text information on a single subject, but are not presentlydesigned to enable comparison and to enhance prolonged, dynamic visualanalysis.

The second major hypermedia application is the World Wide Web.Presently, the technology favors lengthy text over graphics, andgraphics are commonly used as small link buttons and illustrationsrather than as the core data set. While searchable GIS maps andecommerce shopping sites are growing to be among the popularimage-intensive applications on the Web, the quality of theirinteractivity and usefulness for visual analysis and comparison isextremely low. A complex quest is constrained by the slow speed of theWeb's current infrastructure and its standard presentation methods.

For example, the Web's current accepted practice of presenting materialis based on a page-to-page metaphor related to print magazines. Themagazine-like vertical layout requires the scrolling of the page toaccommodate the horizontal orientation of the computer screen. The pageis made up of magazine-like article, illustration, and ad components.The eye roams from component to component, viewing each separately. Textis often lengthy. To obtain additional information, hypertext, symbols,drop-down menus, or query forms are clicked to call up an entirely newWeb page. Often the new material is at a different Web site with adifferent format. The viewer attempts, with minimal success, to carry inthe mind's eye the sequence of information, links, and pages. The viewermust build a mental model of the findings of their inquiry, instead ofhaving this accomplished for them in the computer. It was thisunderstanding and recognition of the problems with the prior art systemthat formed the impetus for the present invention.

OBJECTS AND SUMMARY OF THE PRESENT INVENTION

It is an object of the present invention to provide an interactive dataflow and display system for viewing complex information in a simplifiedand intuitive process.

It is another object of the present invention to provide a method andsystem for studying and comparing visual representations of multipledata sets.

It is another object of the present invention to provide a computersystem for navigating through extensive databases of diverse multimediawherein information is presented on an interactive, keyed map or diagramdisplay in selectively complex layers optimized for user comprehensionvia computer- and/or user-selected image control paradigms.

It is yet another object of the present invention to augment thecurrent, page-to-page World Wide Web file display metaphor with adisplay logic governed by layering information densely in response tointeractive user commands.

It is still another object of the present invention to provide anetwork-based browsing scheme that provides common layering formats andlayout and navigation conventions for simplified orientation andoperation.

It is another object of the present invention to provide special controlapparatus for organizing complex information sets and for user-retrievalof selections as layered or slotted maps and diagrams.

It is another object of the present invention to provide annotationmechanisms to display text data and pop-up, interactive descriptionsabout map and diagram objects.

It is another object of the present invention to provide the ability toestablish standard or common database formats whereby content-providersand users can submit data for display and comparison with other data.The data may be entered on a traditional database interface or withediting tools on an interface showing the relevant map or diagram.

It is a further object of the present invention to provide aninteractive display system that is connected to a network so that remotedata sources may be accessed and displayed in a seamless manner.

It is another object of the present invention to provide aprogram-controlled computer system that is interconnected to a pluralityof remote data sources so that display data includes currentinformation.

The above and other objects of the present invention are realized in aprogram-controlled interactive data processor, such as a personalcomputer, connected to and in communication with a server and linked toa plurality of databases and associated software. These databases,either locally or remotely located, comprise a vast amount of diverseinformation on select topics. The personal computer includes localprogramming to control the layout of information displayed on the userdisplay. The display includes multiple, context-sensitive control panelsor palettes for manipulating the information (symbols, text, drawings,photographs, etc.) presented on the user display in accordance with aselection protocol. This protocol implements a data layering process,wherein information is formatted and displayed in response to usercontrol inputs and stored instructions, optimizing the display layout sothat information is quickly presented in a form that is readilycomprehended despite its complexity. Only information necessary forcurrent assessment is presented without superfluous data elements.Relevant information is thus presented in a seamless, streamlinedmanner.

In accordance with the varying features of the present invention, thecomputer system includes supplemental, back-end, and user-trackingdatabases. The back-end database continuously or periodically gathersand stores new and changeable information so that the displayedinformation is always current. The user-tracking database tracks userevents on the personal computer with the stored data used to returnproper map data, to collect and archive data for the user, to providedata to a user's intelligent agent, and to prepare interactive map anddiagram analysis reports on anonymous, aggregated user activitypatterns.

The foregoing features of the present invention may be better understoodby review of the following description of an illustrative examplethereof, taken in conjunction with the drawings of which:

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 a provides a functional block diagram of the system environmentfor the present invention;

FIG. 1 b provides examples of alternative personal computer devices todisplay the present invention;

FIG. 2 a provides an exploded presentation of the primary command anddata flow between the client and the server;

FIG. 2 b provides an exploded presentation of the system components withan x,y,z coordinate slotting of the GUI (Graphical User Interface)presented and controlled by the present invention;

FIG. 2 c provides an exploded presentation of the gridded slotting ofthe GUI associated with image processing of the present invention;

FIG. 3 provides three examples of the basic map layout and input/outputwithin the GUI (Graphical User Interface) for the present invention;

FIG. 4 provides a GUI/database operations diagram of the presentinvention;

FIG. 5 provides a logic flow diagram for the present invention;

FIGS. 6 a–b depict the components of the graphical user-interfaceassociated with the present invention;

FIGS. 6 c–e depict alternative presentations with the inventive system;

FIGS. 7 a–i depict a seamless stream of display screens for the presentinvention:

FIGS. 8 a–h depict layered indexes and keys with key extenders andretrieval bars to organize and access a large information set;

FIGS. 9 a–d provide examples of informational advertising integratedinto the present system including an interactive map-formatuser-activity report;

FIGS. 10 a–b provide examples of a variety of map displays derived fromthe same database; and

FIG. 11 provides an example of a three-dimensional model as aninteractive map.

DETAILED DESCRIPTION OF THE INVENTION

First, briefly in overview, the present invention is a computertechnology employing a next-generation computer interface, multi-mediadatabases, and a user-tracking system to dynamically build a customized,interactive mapset. It enables content-producers to offer material asstandard-formatted data that can be “picked up” by users as they browse.It enables the user to seamlessly follow a sustained, multi-faceted,analytical thought process by manipulating “map” components, layers, andannotations.

The graphic-information flow method and system uses layering andhypermedia technology to maximize the flow of information, insights, andideas during the process of inquiry. The invention provides an externalaid to enhance reflective cognition (“Things That Make Us Smart,” byDonald A. Norman, Addison-Wesley Publishing Company, 1993, incorporatedherein by reference as if restated in full). The present invention is atrue browsing device for smoothly pursuing a question, for analyzing,exploring, and discovering, for comparing variations, for studyingpatterns and relationships, and for reaching well-informed decisions.

The graphic-information flow method and system is designed to enablecontinuous, focused concentration so that the computer screen becomes anextension of the mind's eye. The present invention enables the user toseamlessly follow a sustained, multi-faceted, analytical thought processby manipulating “map” components, layers, and annotations. Just thediagram pertinent to the moment is viewed, free of distracting,irrelevant information.

Unlike expert and artificial-intelligence systems, here the human beingis the intelligent expert with the present invention serving to augmentthe human thought process. The users of the graphic-information flowmethod and system are active participants. They gain knowledge andunderstanding through the hands-on process of map-making. Userscustomize information sets by selecting layers and filling slots, thenby querying to refine them. Individual analysis is further supported byproviding marking tools to both stimulate and record insights.

The invention combines hypermedia and layering technologies. It enableslayers produced by graphics, drafting, and information systems to beorganized and formatted into easy-to-use frameworks. Non-technicalproducers can create multi-dimensional interactive documents and reportsfor wide distribution. The maps can be accessed by non-technicalaudiences either the general public or experts in a field of study.

The map-based, graphic-information flow method and system can be used tosignificantly improve the ability to study almost any complex subject.By representing a place, topic, or thing in a multi-dimensional map,previously-hard-to-recognize patterns and relationships can bediscovered. These would otherwise not be apparent by attempting to viewdirectly the place, topic, or thing or by more traditional analyticalmethods.

The method and system employs what is sometimes termed “cognitiveart”—visual representations that aid the comprehension of complexinformation sets. (“The Visual Display of Quantitative Information”1983, “Envisioning Information” 1990, and “Visual Explanations” 1997 byEdward R. Tufte, Graphics Press, Cheshire, Conn., incorporated herein byreference as if restated in full). The term “map” is most commonlyassociated with a flat, simplified representation of a landscape fromabove. A map can also be any visual portrayal of a geographic area orimaginary place including a cartographic, diagrammatic, photographic,perspective, or bird's-eye-view image or three-dimensional model. Aswell, a map can be a diagrammatic representation of a complex object(the human body, a vehicle, a building). A map can also graphicallyportray a topic for which a set of pictures or words are understood moreclearly in a series of subsets and in relationship to each other (anorganizational chart, a chemical sequence, or a set of scaled, colorimages of possible plants for the garden of different heights andflowering seasons).

In relation to the present invention, the important addition to any suchpicture chart, diagram, or graph that makes it a “map” is the provisionof interactive keys. These keys do more than merely define map symbols.The interactive keys enable the user to quickly switch between viewsshowing only selected subsets of interest at the moment.

The resulting ability to instantaneously customize views of informationsets supports a mapping process of:

1) setting out the significant features of a place, topic, or thing,

2) defining the features' relevant attributes,

3) seeing what attributes various features have in common and how theydiffer,

4) detecting how often or rarely features and attributes occur, and inwhat patterns, and

5) noticing the significance of their real or symbolic proximity to oneanother.

Understanding of the patterns and relationships often benefits fromannotations viewed temporarily in association with map features. In thepresent invention, text, charts, drawings, photographs, animations,sound, or video footage may be attached as annotations to map features.

The present invention combines a diagrammatic map with illustrativepop-ups. This dual-view design reflects the analytical mind's-eyeprocess of switching back and forth between the overview structuralimage of a subject and close-up, eye-level views or “vignettes” ofparticular features. To aid this mental process, two perspectives can beseen at once. First, the content of the overview is pulled apart andorganized into layers or matrices. Second, the descriptive feature viewis shown directly in association with the feature's place on theoverview.

The overview enables examination of numerous meta-representations of thewhole place, topic, or thing. By switching groups of features in thelayers or slots, the viewer can focus on studying patterns andrelationships within particular subsets of the whole.

Individual features can be examined “up close” via pop-up annotations.For the same reasons that sidebars, summaries, and sound-bytes areuseful and effective, the material in these descriptive close-ups isstripped to the essentials and consolidated into graphic representationsand short text. These annotations are accessed in digestible chunkswithin “pop-up, flip-thru storybooks.” The viewer studies anintroductory pop-up card, then can click to go forward or backward in aseries of flip-cards which further describe the map feature. In thestorybooks, short flip-card animations are used to economically createdramatic explanation. When animation and video is used in pop-ups, it isin the form of short clips. Animation and video is used not to purelyentertain. Its purpose is to clarify or explain the character andmulti-dimensional aspects of a place or object, product assemblyprocedures, or the pattern of a movement such as a rock-climbingmaneuver or a hurricane's path. Pop-up materials are concise in order toaugment and enlighten, but not distract from, the study of the mapoverview.

The graphic-information flow system is perceived as a set of “maps”—anatlas or a catalogue. Thereby the body of information attains thefeeling and credibility of a single reference object even thoughmaterials may be pulled dynamically from many sources. The inventionenables data from these numerous sources to be stored in a common formatso that, for each user, material is gathered during the browsing processinto a personalized mapset.

The present invention provides an online alternative to reference bookssuch as product catalogues, yellow pages directories, travel guidebooks,entertainment listings, encyclopedias, natural history guides, textbooks, machine manuals, and land-use planning reports. The presentinvention can also provide an online specialty store where consumers canask to see and compare all the available offerings for a particular itemfrom a multitude of manufacturers and distributors. As well, the presentinvention can be used to create an image-based library for comparingsimilar objects such as ceramic vases, volcano eruptions, colonialchurches, and butterflies.

With the graphic-information flow system, producers of information gainby being able to reach viewers more effectively than by current printand electronic methods. At this time, Internet producers put up aself-standing Web site which viewers must learn of and locate, usuallyvia a search engine, and then must browse through to find one piece ofinformation at a time. The present invention enables the creation ofdigital repositories with standardized formatting to aggregate data frommany sources. With the graphic-information flow method and system, thevalue of every piece of information is increased exponentially by beingeasily viewable in proximity with other related information. Viewers cancomparison shop for products, travel plans, and points-of-view.

Pop-up annotations augment without breaking the comparison process. Eachpop-up is a sidebar-like annotation to the body of information on themain viewing area of the map; therefore viewers are more likely to takea few moments to explore the descriptive material without fear ofgetting lost. The map remains the orientating device to come back to.Viewers feel in control and can digest the descriptive material at theirown pace. Pop-ups about geographic sites have added power because theyare seen and remembered in association with the site's location. Pop-upscan serve as an effective and useful advertising mechanism sought afterby prospective consumers. Unlike Web banner ads, viewers are actuallyasking to see the ads or “info-tizements” because they are associatedwith the topics the viewers are researching.

With the annotation and publishing tools, users of thegraphic-information flow method and system can define new features andattributes to contribute to a mapset and can post new layers and mapsetsonline to share with others. The graphic-information flow method andsystem is intended to take publishing beyond the single-source,broadcast model to the many-to-many model. At the same time it isintended to provide the ability for respected experts andinformation-integrators to create tangible, credible, “branded” hubsthat take responsibility for the quality of the content they makeavailable.

The graphic-information flow method and system for visually analyzingpatterns and relationships is a computerized reference map system forassembling and integrating a set of materials about a place, topic, orthing in order to enhance the flow of information during the process ofsearching for knowledge and insight. A database-derived “map” displaysrepresentations of a place or a set of objects to be compared. Thissingle, compact computer user-interface with layered indexes, keys, andcontent enables discrete sets of material from a dispersed network oflarge, multimedia databases to be accessed smoothly and repeatedly.

The method and system software uses layered and slotted maps withclickable map keys. The viewer manipulates “map” components, contentlayers, and annotations by clicking symbols. Clicking symbols on mapkeys and query boxes shows and hides graphic features with requestedattributes. The features are organized in map layers and slots. Clickingmap features shows and hides text messages and pop-up annotations aboutthe features. The viewer thereby easily studies features in context withother relevant graphic information. The invention provides for smoothlycalling forth a set of graphic data to inform and stimulate a sustained,multi-faceted, analytical thought process.

The software may be deployed as a stand alone application and onenterprise, intranet, and internet networks. It may be used intraditional personal computers and in future computer systems employingscreens that may be flat, wireless, and/or pressable or pen-responsive,that may be larger or smaller than current PC screens, and that may beas portable, thin, foldable or rollable as a paper map or chart (seeFIG. 1 b).

The graphic-information flow method and system for visually analyzingpatterns and relationships is realized through computer software. Thepresent invention consists of template computer software for publishinga set of materials in a format that the user can smoothly browse. Thesoftware calls from a multimedia database to display a graphicaluser-interface (GUI) and alter it in response to user commands. The GUIhas a central layered or slotted map area surrounded by control panels.

The software employs “smart” graphics as symbols on maps and controlpanels. The graphics are “smart” in that they can be programmed torespond to user commands, calling to a database to cause an action.Users click control panel keys and query boxes to fill map layers andslots. Users point at and click “smart” graphics on the maps to callforth annotational text, images, sound, and video. Users at the back-endand front-end create, drag, reshape, reprogram, and otherwise change“smart” graphics with editing tools.

The graphic-information flow system software template consists of GUIs(graphical user-interfaces), multimedia databases, and the software forconfiguring and operating the maps. The GUI is designed to permitoperation on a variety of existing and future hardware devices; and thesoftware can be developed using commonly available software languages,database programs, and electronic information systems.

Software on the server and client performs a number of functions. Thetemplate software enables customization of the database features,attributes, symbols, annotations, and topic organization; of the GUIlayout; and of the animation and query configurations. GUI and databasetools are provided for initial mapset creation and subsequent editing byauthorized editors, dynamic databases, and public users. Softwarecomponents include map and database interfacing; dynamic generation ofgraphics, imagemaps, and code; and user-tracking and activity-reporting.Directory and query box formatting automatically turns text lists intoformatted top-layer graphics with retrieval bars and key extenders asnecessary. The software uses “smart” graphics to provide for interactivekeys and map features, map graphics layering and slotting, querying, andnotation and publishing tools. The software also accommodates signalingfrom input/output devices such as GPS and adaptation to future input,output, and selector devices.

Special control apparatus are used extensively throughout the system'sgraphical user-interfaces to retrieve layered indexes, keys, and mapcontent. These special control apparatus enhance the ease of browsingwhile accommodating the size and resolution limitations of the computerscreen. These preferred special control apparatus are designed toimprove operation, but are not required and do not preclude use of otherspecial control apparatus.

Five special control apparatus augment the index, key, and mapconfigurations. First, message boxes within the map area show updateabletext data. The message is typically: 1) the name and other tabular datafor a feature in response to the cursor pointing to the feature, or 2)data for a set of features which is updated dynamically astime-sensitive information is changed in the database. Small messageboxes also may appear as pop-up feature labels atop the map. Messageboxes may be used for the viewer to type text input. Second, retrievalbars are used for switching information in indexes, keys, message boxes,and pop-ups. Retrieval bars use graphical or alphabetical segments thatprovide an improved alternative to traditional scroll bars. Third, keyextenders revise control panel and message box content via overlays andpop-ups. Key extenders provide means for selecting additional featureattributes and for switching topics and sets of keys or message boxcontents. Keys are extended by clicking on topic titles or arrows.Fourth, query boxes, that may be in the form of key extenders or maparea pop-ups, provide means for selecting multiple attributes for acomplex query. A query is requested by clicking a button; and theresults are returned by updating the map area. Fifth are user editingand publishing tools along with interactive how-to guides and tutorialsthat take new users through notation and publishing procedures.

Having the foregoing objects and functionality in mind, attention is nowdirected to a specific implementation of the invention. Referring now toFIG. 1 a, the inventive system is first presented in functional blockdiagram form. Specifically, the system includes one or more workstationsor other personal computer devices 10 with both local programming 11 andcommunication 30 to a remote server 20. This server includes additionalprogramming 24 to assist operation and a central multimedia, relationaldatabase 21 and 22 containing a number of support databases stored inhigh capacity memory. Exemplar memory modules include Base memory 21 andTopical memory, 22. In this context, select mapping elements commonlyknown as Base elements will be stored in the Base memory module and theTopical elements in the Topical memory module. As database entries,these elements are available for high speed delivery to each of thepersonal computer devices, either sequentially or concurrently, via thenetwork link 30. A user-tracking memory module 23 stores data about eachuser's activity. To enhance this dynamic capability, the system includesan expanded link to the Internet or other network connections 50 so thatthe vast array of Internet or network source materials may be accessedand combined with the base and topical data of the central database andthus become available as information for mapping onto the selective twodimensional display. In addition to the role as a source for databaseinformation, the Internet and other network connections permits remoteprocess control of the database content, including access and editingfunctionality via the personal computer devices 10. FIG. 1 b showsalternative personal computer devices such as (a) high-resolution,large-scale, flat map display, (b) large-scale, wall-mounted display,(c) wireless, portable map and remote server, (d) portable, flexible,roll-up, flat map display, (e) portable, fold-up, flat map display, and(f) map expands and contracts as display is stretched or folded.

Turning now to FIGS. 2 a–c, the system components are depicted inexploded view format. In these diagrams, arrows are used to indicatecommand and data flows. FIG. 2 a depicts the primary command and dataflow between the client and the server. To permit the seamless customdata flow to the presentation, the system display includes a map area303 for imaging the map elements as recalled from the server 200. Tocontrol data selection and access, an interactive control panel with mapkeys 304 is displayed on a portion of screen real estate, withselections thereon governing the map area. When the User 301 causes auser-event such as a mouse click to the map or control panel, a sequenceof software commands occurs reflected by the arrow to the Client-sideSoftware 101. A browser program 101.1 parses the request and runs theclient agent software 101.2 which may consist of HTML, Javascript, CGI,Java, ActiveX and/or other code. The client agent software processes therequest and alters the map area image reflected by the arrow back to thedisplay. If a complex query, additional graphic files, or updatedinformation is required, the client agent sends a request to the serversoftware 102 and multimedia relational database 200 that may reside onthe client or across a network on another computer. This requesttriggers a sequence of events which gathers and assembles the graphicmaterial on the server and sends it back to the client for display.

Importantly for the invention and as is discussed in detail in FIGS. 2 band 2 c, elements comprising separate layers are stored in addressabledatabases, including central server files and databases 200 (comprisingbase 202 and topical 203 data sets, graphics files 204, anduser-tracking database 404) wherein the grid depiction reflects datafields for each cell. The server software first uses a daemon 102.1 toreport to the user-tracking system 404 in order to record the event andto retrieve relevant information about the history and state of user'smap and any files on user preferences or from a user's intelligentagent. The server software then calls a database access daemon 102.2 toquery attributes as necessary and to look up in the databases 202, 203such information as feature name, symbol, x,y location, z-layer, andannotation display data. The server then uses the results to determinewhich graphic files 204 to retrieve, how to plot and layer them, and howto reconfigure the interactivity of the graphics such as imagemaps (theareas of the map which respond to user events). The resulting GIF andimagemap coordinates and scripts are sent back to the client fordisplay.

FIG. 2 b represents the various system components. At the top, thetwo-dimensional information content of the display provided to the User301 is depicted in exploded view as layers forming display content withthe context of a geographic setting comprising elements such as rivers,streets, parks, etc. As can be seen, the layers are each characterizedwith select information that is of varying importance to the User. Thebase map elements are pulled from the base database 202 when the userfirst calls up the mapset. The User interactively turns additionallayers of map data on and off to provide a more complete but concisedata presentation via interactive control panel entries as describedabove in FIG. 2 a. The topical database 203 provides content and displayinformation for “smart graphics” 309 on topical layers 306, text in themessage box 307, and pop-up annotations 308. The interactive “smartgraphics” 309 on the control panels, base, topical, and pop-up layersare associated with user-triggered scripts and data in the databaseswhich govern changes in the control panel and map area display inresponse to particular user input. Additional data is retrieveddynamically from secondary and third-party databases 504 at the back-end502 of the system, passing through a security device 505. Contentproviders and editors 501 can alter content via back-end interactive mapinterfaces 503 that send graphics files and data to back-end databasesand through security to the central server 200. The user-tracking system402 enables aggregated user-activity patterns collected in theuser-tracking database 404 to be viewed on a map interface 403 by systemoperators 401.

FIG. 2 c depicts in exploded view a slotted-format display configurationin which base data is positioned in designated sub-areas of the maprather than via x,y coordinates as in FIG. 2 b. This type ofslotted-format can be used for any chart layout. In the illustration, agridded base map 305 provides the containers for a set of “smartgraphic” objects 309 to be compared. Upon calling up the mapset, theviewer 301 may use the control panels 304 to query the database for aselection of objects that meet certain criteria. Once these aredisplayed in the map area 303, common features of the objects may beselected via the control panel key for layering or hiliting 306. Bypointing the cursor at a selected object or feature, the viewer requeststext data to be retrieved from the database and displayed in the messagebox 307. By clicking on an object or feature, the viewer requests apop-up annotation 306 about the object.

The graphic information flow system can display images representing anyplace, topic, or thing. Three types of map layout within GUIs (GraphicalUser Interfaces) are shown in FIG. 3. The layered map, 3 a is used forsets of features with relative spatial locations that can be positionedby x,y coordinates. The slotted map has sets of discrete featurespositioned in a grid for comparison, 3 b or in a chart with slots placedto represent features' relationships, 3 c. Each layout starts with abase map and a control panel, 601. The user clicks the key to select onetopic for display, 602. Also illustrated in 602, the user may point at afeature on the map to view text data in the message box. To comparefeatures, the user selects from the key another topic or attributesubset for display and comparison, 603; this may be repeated to show andcompare other topics; clicking the key topic a second time deletes thatfeature from the display. In 604, the user clicks on a map feature toview a pop-up annotation. The interactive pop-up appears in an area awayfrom, but near the feature which is now hilited.

FIG. 4 shows the basic GUI/database operations that the database callsas a result of the GUI Input/Output sequences of FIG. 3. The TopicalDatabase, 203 at the center of the drawing stores a set of feature andattribute data and is updated dynamically from the back-end interfaces,503 and back-end databases, 504 at the top left of the drawing. As Usersinteract with the system, activity data is recorded and stored inuser-tracking system, 404 and available for User activity reports, 403.

At the bottom of the drawing, a series of GUIs as seen above in FIG. 3 care shown. The broken lines indicate command sequences from the GUI toaccess the data via key “mouse” selection from the Topical Database,203. In operation 601, the User “click” to topic “AA” on the controlpanel key, 612 alters the map display, 611 and displays that topic.Specifically, the system retrieves the source data from the topicaldatabase, 203 and determines the symbol, pattern, and color for “AA”attribute, 210. Thereafter, the system provides the slots or layerscorresponding to the “AA” attribute, as indicated by the “X”s in thecolumn headed by the “AA” designation, 214. All corresponding data itemswith the “AA” attribute, 214 are then placed on the Map area, 611.

In operation 602 of FIG. 4, the user points to one feature on the map toview text data about the feature. The software determines the slot orcoordinate of the cursor and finds the slot designation or x,ycoordinate in column 211 of the database, 203. The software retrievesthe name from column 212 and text description of the feature from column213. It displays this text data in the message box, 614 and/or the namein the label, 613, positioning the label near the feature.

In operation 603 of FIG. 4, another feature, “DD”, is selected and thisis used to find corresponding entries from the topical database, 203, asindicated by the “X”s in the column under the “DD” attribute. Thesefeatures are then presented on the screen, available for User review.

In operation 604, a click on a feature, 615, causes the display of aninteractive pop-up annotation, 616. When the pop-up appears, the featureon the map that was clicked is hilited to retain the connection betweenthe annotation and the feature. The configuration of the pop-up, 305 isdetermined by the data in columns 216 and 217, informing the software asto which graphics, text, and sound to retrieve from the file, 218. Thepop-up itself may be interactive with mouse clicks triggeringanimations, 605, or causing new pop-up cards to be displayed, 606.

In order to call forth another mapset, the user clicks an index or acontext map or diagram, 607. The context control, 617 shows the presentlocation of the current map in the mapset. Clicking its hilited areascalls up the master directory or switches to other maps. The other mapsmay be another representation of the same data or a related informationset.

The initialization of the program, navigation to the desired mapset, andmanipulation of the interactive map are depicted generally in theflowchart of FIG. 5 and begins with the start up, 100 when the Userclicks on the program icon to enter the system. The resulting actionsinclude the recording of a User ID in the user-tracking system, 190 andthe system calling up the program from a CPU, CD-ROM, network orinternet server. The start-up screen is displayed with a base map or adirectory of available mapsets. A directory may have a text or graphictable of contents or index; or it may be a single graphic representationof the contents such as a world map or other overview image, or acombination of the two. The how-to event, 101 is optional and may beaccessed at any point. It involves the User clicking on a “how-to”button. The program calls up a screen or animated overlay withinformation about how to use the program. This is preferably a shortanimated sequence on top of a view of the directory (if applicable) oron top of a view of a base map. In the directory or base map key, Usersmay be given a choice of written languages which is noted as a variableand referenced whenever words are displayed.

If the software includes a directory, the User may click, 102 on adirectory extender control apparatus. The directory will then berevised. The program will call up additional subdirectory text or zoomin on a world map or overview image. This process is repeated until thedesired mapset is identified by title or image. The selection of thedesired mapset is accomplished via event, 110 in which the User clickson a mapset title or image. The program displays a base map for a mapsetof a place, topic, or thing. The selected mapset is recorded in theuser-tracking system, 190 and subsequent user-events are also recorded,191–194.

Once the base map is displayed, the User will use the control panel keyto select the first topic set for display on the base map. The User mayfirst need to click on the key extender, 120 to revise the key in orderto view the desired feature-set. The User clicks on a key symbol, 121,and the feature-set is displayed on the map. To accomplish this, theprogram searches in the database and recognizes the feature-set (layer)associated with the x,y coordinate of the mouse click (see FIG. 4,Operation 601). The program finds the column in the topical database forthe requested feature-set. If part of the database is designated forsymbols or a symbol is associated with the topic column, the programnotes the symbol designated to represent the topic and finds rows withthat column checked (see FIG. 4, 210). If part of the database isdesignated for images or “image” is associated with the topic column,the program notes which rows have an image. For each checked row, theprogram retrieves the symbol or image from the graphics file or cachedimages on the client and displays it at the designated x,y coordinate orin the designated slot, replacing the graphic of the base map.

If the symbol is not a rectangle, the program determines its shape. Theshape may be a set of points for a line or polygon or a bitmap graphicwith a mask. The program alters the map only for the area within thesymbol. If the symbol (typically a shape or polygonal area) isdesignated as transparent, the program calculates the alteration of theunderlying map colors within the area. For gridded slots each showingimages of similar objects for comparison, the appropriate feature of theobject is hilited. For layers or slots, a hilite may be an outline orfilled shape; it may be opaque or a transparent tone altering the colorof the underlying image.

If the User clicks on the same key symbol, 122, the feature-set isdeleted on the map. The program repeats the actions of 121, but deletesthe symbol or images by displaying the appropriate portion of the basemap image (stored in the user-tracking database) in its place. If theUser clicks on a symbol or label in a query box or enters text in aquery box, 130, the feature-set is displayed on the map by anothermeans, as follows. The program repeats the actions of 121, but searchesfor multiple columns to be checked or searches for text matches in acolumn. It displays a symbol, image, or hilite at the designated x,ycoordinates or in the designated slot, replacing the graphic of the basemap.

The User then will click another key symbol or query, 140 adding a newfeature-set to the map. The program repeats the actions of 121, but doesso in comparison with other symbols, images, or hilites currentlydisplayed (see FIG. 4, Operation 603). If two symbols have the samecoordinates or overlap, the program uses an algorithm to adjust theplacement of the symbols so that all or part of both are visible, anddetermines which should be displayed on top of the other. If the topicsuse patterns, colors, or hilites as symbols, the program determines athird, combined pattern, color, or hilite to signify its representationof two attributes or for the overlap. For an “and” query, the programwill hide previously visible symbols for features that do not have allthe attributes. This action may be repeated to add other symbols; andkeys for visible features may be clicked to hide their symbols.

Two means of viewing annotational material about map features arepossible. First, if the User points with the cursor (mouseOver) at afeature (symbol) on the map, 150, a message and label may be displayed(see FIG. 4, Operation 602). The program searches in the database andrecognizes the feature associated with the x,y coordinate of the mouselocation. If there is a message box on the map, the program displaystext from the database in the message box of the map. If labeling isbeing used, the program reads the name for the feature from the namefield. It calculates the size of the label based on the number ofcharacters and the width of the font being used to size the label. Itdisplays a label with the name next to the map symbol or in the slot;the label may have a line that connects the symbol to the label set at adistance to allow viewing of the area surrounding the symbol. A defaultlocation in relationship to the map symbol or slot determines itspositioning. If the label would go outside of the map area or is toolong for the slot, the program shifts it to an acceptable position. Whenthe User moves the cursor away from the symbol (mouseOut) or clicks thesymbol, the label is hidden, but the message box information may remain.

Second, if the User clicks on a map symbol, 151, the program displays ahilite around the map symbol and a pop-up is displayed. The programsearches in the database and recognizes the feature associated with thex,y coordinate of the mouse click (see FIG. 4, 604). If the row haspop-up annotations, the map symbol is hilited and the first pop-up cardis assembled as described in the database (see FIG. 4, 305). The programcalculates the quadrant or portion of the map within which the x,ycoordinates of the map symbol are located. It then determines anotherappropriate quadrant or portion of the map over which the program willdisplay the pop-up. It then replaces that quadrant or portion with animage that combines the shadowed pop-up edged by the visible map graphicsurrounding the pop-up.

The pop-up itself may be interactive. If the User clicks on a pop-up hotspot (a button, object, icon, or imagemap), 152, the pop-up is altered(see FIG. 4, 605). The pop-up displays additional information includinglinks to other graphic and text data, animations, and sounds based oninformation in the database (see FIG. 4, 216, 217). If the User clickson a pop-up corner, 153, the pop-up changes to a new card. The programretrieves the next or previous pop-up card based on information in thedatabase (see FIG. 4, 606). For written languages that read from left toright, clicking on the right corner calls the next pop-up card, andclicking on the left corner displays the previous card. This may bereversed for languages that read from right to left. Forward and backarrow symbols may be placed on the corners.

If the User clicks on a symbol or map while the pop-up is showing, 154,the pop-up is hidden. The hilite of the map symbol is deleted and theoriginal map replaces the pop-up in the quadrant or portion of the map.Clicking a key symbol also hides the pop-up before altering the mapdisplay. The program may be set up so that clicking on another visiblemap symbol will simply replace the contents of the pop-up and repositionit if appropriate.

If the User clicks on a notation tool for text, lines, or shapes in thecontrol panel, 160 optional, the cursor changes to the I-beam (for text)or a cross (for a line or a shape). The User presses on the map andtypes or drags. Upon release, text, line, or shape notations are made ontop of the map and recorded in the user-tracking system. The notationlayer symbol is hilited on the key (additional notation layers may beprovided). When the User clicks on a key symbol for the notation layer,the notations are hidden or shown.

User-editing, 170, is optional for public users; this is the processwhereby authorized Editors add information via a password-protectedback-end interface (see FIG. 4, 503). When an Editor or User clicks on asymbol tool in the control panel or in an edit or tools menu, a newsymbol is created. A copy of the selected symbol is positioned on anappropriate place on the control panel or map. The new symbol is hiddenand shown several times to call attention to it. When the Editor/Userpresses on the new symbol and drags to a position on the map, the symbolis moved. The symbol is repeatedly repositioned to the x,y coordinate ofthe cursor. If the cursor moves beyond the map boundaries, the symbolstays at the edge of the map. When the Editor/User releases, a row isadded to a database with the symbol, an ID number, and its x,ycoordinates.

Authorized Editors' changes are entered in the base map or topicaldatabases, as appropriate. For public users, the row is added to theuser-tracking system database within a user-added layer associated withthe User ID. A data entry dialog box appears in which the Editor entersname, message information, and pop-up data; this is optional for publicusers. When the Editor/User enters a name and other data and clicks“OK”, the data entry dialog box disappears. The name and data areentered into the database row of the new symbol and then are called upwhen the User clicks a new symbol, 150, 151, 152. If the Editor/Userdoes not press a new symbol or clicks “cancel” in the data entry dialogbox, an alert message appears asking the User if they want to delete thesymbol. If the User clicks “yes” or “cancel”, the alert dialog boxdisappears and the new symbol is deleted. If “no”, the data entry dialogbox reappears. If the Editor/User clicks the delete-symbol tool andclicks on a user-added map symbol, a symbol is deleted from the map andthe row is deleted from the database. An “Are you sure?” dialog mayappear before doing so and the User may thereby cancel the deletion.

Editing may also be done via a database interface. If the Editor/Userclicks on “view database” in the control panel or in the edit or toolsmenu, the appropriate portion of the database appears in the map area.Any fields that may not be edited are grayed. The Editor/User may addrows and enter text in the database. The Editor/User may toggle betweenthe database interface and the revised map to view and modify changes.

Users may save, print, and publish their mapsets, 180. When the Userclicks on the “save” button or menu, the mapset is saved. When the Userclicks on the “print” button or menu, the mapset is printed. When theUser clicks on the “publish” button or menu, the mapset is publishedonline.

EXAMPLES

An exemplar GUI (Graphical User-Interface) layout and its componentsshown in FIG. 6 a is designed to organize information from an extensive,complex data set. The special control apparatus maximize ease inretrieving subsets from the database. The navigation to the desired mapcan be accomplished via an optional index, 1–4, on the left by clickingon bar segments and list items. Retrieval Bar, 1, for switchingcategories of mapsets and Retrieval Bar, 2, for switching subcategoriesof mapsets call forth clickable lists of mapsets, 3, within the selectedcategory and subcategory. The example shows a list organized inalphabetical order. Retrieval Bar, 4, is used for calling forthadditional list information. The hilited segment designates the portionof the list that is displayed; clicking another letter calls up theportion of the list starting with that letter. Clicking on a map name inthe list brings its base map into the Map Area. Orientation andnavigation within a set of maps is accomplished via the Context Map, 5in lower right, which shows the location of the present map within thenext higher level map. Clicking outside its toned area, calls forth thenext higher level map (zoom-out). Zoom-in capabilities, 5 a, areprovided via a key-accessed layer showing clickable zoom-in areas on themain map. Clicking on the “Home” icon, 6 upper right, retrieves thetop-level map of the mapset.

Upon retrieving the desired mapset with its basemap visible in the MapArea, the user may click on the Topic Selector, 7, to retrieve site orobject information for a particular topic in several ways. Clicking theunderlined topic name will replace the base key with a topic-relatedkey. Clicking on the box to the left of the topic name will call forth aquery box in the key or as a pop-up (see FIG. 6 b). Clicking on the downarrowhead will replace the topic list with a list of subtopics. Theretrieval bar above the list shows the number of levels of topics andsubtopics including and above the current subtopics list; clicking asegment will return to the higher-level topics list. Clickable keys areused to show and hide overlays to the basemap in the Map Area. The key,8, shows a set of symbols; when a symbol is clicked, the software callsto the database to show all that type of site or object positionedproperly on the map. Keys for additional types of site or object areaccessed by clicking on the “next” and “back” arrowheads at upper rightof key, 8 a.

The central Map Area displays the content as sets of map symbols. Mapsymbols, 9, for sites and objects with information in the database are“hot.” Pointing at a symbol will call forth into the message box, 10,the site/object's name and descriptive material. The message box is alsoused as a title bar to display the mapset title and subcategory title,10 a. Clicking on a map symbol will cause it to become hilited and apop-up, 11, to appear in a part of the map other than that in which thesymbol is located. The pop-up has interactive, annotational materialabout the site or object. The material in the pop-up may be presented onmultiple cards that are retrieved via the segmented retrieval bar, 12,at the bottom of the pop-up. Special theme keys, 13, may be providedbelow the map. Sponsor name and message, 14, may also appear in thisbelowbar. Publisher, editor, and access to use, restrictions, and otherreference information, 15, may be located in the key or belowbar.

FIG. 6 b shows a pop-up query box. The retrieval bar, 1, is clicked tocall forth lists of attributes. The attribute list, 2, is clicked toselect attributes which appear in the selections list, 3. Clicking the“plot” button, 4, causes the query box to disappear, the requested queryto occur, and symbols representing sites or objects that have theselected attributes to appear in the map area.

FIG. 6 c shows an embodiment of the GUI layout with each of thecomponents diagrammed in 6 a. FIG. 6 d shows another embodiment of theGUI layout within a World Wide Web browser. The user has undertaken asearch for a selection of hotels by clicking the box to the left of thetopic “Lodging” and thereby called up the “Lodging” query box forselection of query criteria, 6 e. A list of applicable hotels with aretrieval bar then appeared in the key area; this list may be clicked tohave a particular hotel hilited on the map. The User has also clickedthe key and special theme selector in 6 d to view subway stops,trolley-boat tours, and scenic views. The user has then clicked on ahotel symbol on the map to view annotational material in the message boxand pop-up, 6 d.

In FIGS. 7 a–g an example is provided depicting the use of the presentsystem for assessing sophisticated geographic information. The seriesillustrates how a vast amount of information can be organized within asingle, small screen and how its layered data can be retrieved by meansof exemplar special control apparatus. The sequence begins with a userbrowsing a series of interconnected, geographic maps. Beginning withscreen display 7 a, a base map of the world is provided in atwo-dimensional presentation. This interactive, layered map can beeasily reconfigured by the user. In this display, the control panelincludes the following topics specific to the first base map:

-   -   1. Current Events    -   2. Environment    -   3. People of the World    -   4. History/Geography    -   5. Metro Areas/Cities    -   6. Travel Planning

In this example, the User has selected the “Current Events” topic in thecontrol panel, resulting in a second key of subtopics:

-   -   1. Time/Sun-Shadow    -   2. Weather    -   3. Geography & News        -   a. Government        -   b. Science/Nature        -   c. Business        -   d. People

The user wishes to view the time in different cities of the world,weather, and news. As new data are called for, the system pulls fromthird-party databases and public information Web sites; and itdynamically refreshes the display with the most current entries.Pointing at a “hot news” symbol has called forth a headline in themessage box; clicking it would call forth an interactive map of the newssite in place of the world map. Further maps on weather as well asgeographic information on news stories can be called up by clicking onthe Current Events key. In FIG. 7 b, the user changes the cities on theclock and map by clicking on a city name to call forth an overlayselector-list. The viewer selects a new city by clicking “Athens” on thelist; the city circle moves to the position of Athens and the name andtime of Athens replaces those of the previous city from that portion ofthe world map. Clicking the clock name again hides the selector-list.

The interactive world map is also used as a directory to an extensivemap atlas. The world map can be clicked to zoom into regional mapsets;or the index listing the map locations (to left of map) can be used (seeFIG. 6 a, 1–4). The index can be clicked to show other world maps; theretrieval bar at its top can call up lists of continent, country, state,and region maps. In this scenario, the user clicks “Travel Planning” onthe topic index (to right of map) and the related key appears below,shown in FIG. 7 c. The user then clicks “Travel Packages” in this key.FIG. 7 d shows that a new control panel has now replaced the key (it canbe hidden by clicking the topic selector “Travel Planning”). The > and <arrowheads in the key can be clicked to flip forward and backward toview additional travel packages. The user has selected a city of originand a week by clicking on the up and down arrowheads. Symbols thenappeared on the world map showing available trips. Pointing at theHawaii map symbol has caused descriptive information to appear in themessage box and belowbar (below the map). Clicking on the belowbar >arrowhead would call forth data on additional packages. Clicking on“View” would place interactive descriptive maps, images, and text on topof the world map; clicking “View” again would hide the description.Clicking on a continent name below the map would call forth a continentmap showing travel packages.

The user now clicks on Hawaii on the world map or the index of FIG. 7 d.Note that an alphabetical retrieval bar can be used on the bottom of thelocation index (at left) to scroll through the list. The user hasproceeded from a full map of the islands to a map of the Big Island ofHawaii, FIG. 7 e by clicking on the context map at lower right. Clickingon the Beach symbol on the key has caused symbols for beaches to appearon the map. Clicking on the belowbar special theme selector has calledforth an overlay showing the area covered by rainforest. Pointing at anatural-features symbol (for Akaka Falls) on the map causes its name toappear in the message box; clicking the map symbol pops up adescription. The pop-up itself has several interactive features.Clicking the speaker symbol on the pop-up would run an audio/video clipof the waterfall in place of the photograph. Clicking on plant nameswould cause an image of the plant to appear in place of the waterfall.The retrieval bar at the bottom of the pop-up shows that there are fourcards in the pop-up with the first showing; clicking other segmentswould call forth other interactive cards about the subject.

In FIG. 7 f the user has clicked to zoom into a nature reserve andintersects with the mapset and database of the naturalists studying thearea. The visitor can get a picture of what the hiking trails are likeand learn about the ecosystems. The scientists create and study theinteractive maps to discern relationships between various elements ofthe environment. In the example, a biologist compares overlays showingthe location of plants and animals to study how they coexist. Thebiologist has selected specific insects and plants for display via thecategories at the top of the key. He has chosen to view only theterritory of one insect and one plant to study their interrelationshipand their relationship to the general land form. Numerous other layerscan be shown and hidden quickly via the key. In this way, only the setof material of interest at the moment is viewed, without distraction ofirrelevant information. The biologist has clicked on the “Plant Species”key box to access the database. The query box has appeared and is beingused to identify and map other species having certain criteria. Thecharacteristics are clicked on the list at the left of the query box andthey appear as selections at right. The retrieval bar at the bottom leftof the query box calls forth other choices. Once all criteria areselected, clicking on the “plot query” button maps species that meet thecriteria. A clickable list appears in place of the key, FIG. 7 g; thelist can be hidden and recalled by clicking on the “Plant Species” keylabel.

The results of the plant species query may also be viewed in a slottedmap by clicking on the “Grid” or “Graph” selectors in the key, 7 g. FIG.7 h, shows a comparable display for a selection of insects. This type ofslotted map serves as a catalogue for viewing and comparing objects sideby side. The interactive key enables further queries and the showing andhiding of features. The hilite capability can call out a particularcommon feature on each image (e.g., the thorax, the wing's subcostavein) and may gray the rest of the image. The material in the slots maybe layered to show cross-sections of things such as an insect's internalanatomy. An interactive pop-up, flip-thru storybook provides descriptivematerial about each object; note the subject-headed retrieval bar. Thebiologist views images of plants and insects collected in the study areaalong with those that have been archived. The biologist can also accessvia the internet other researchers' information on similar species fromislands around the world. Over the years, a database is compiled fromfield investigations. Weather data is collected and updated dynamicallyfrom field stations. The scientists have used the back-end interface toadd their research data via both a database interface and a mapinterface. The biologist views a chart of weather data, FIG. 7 i, ontowhich can be layered time periods related to biological processes. Helooks for cause and effect by studying the hatching of an insect, theblooming of a flower, and the patterns of sunny, rainy, and foggy daysvia the species key below and the pattern analysis key at right.

FIGS. 8 a–h show the use of layered indexes and keys with key extendersand retrieval bars to organize and access a large information set. FIG.8 a shows a sidebar panel with topics list and a symbol key. The >arrowhead on the key for 8 a can be clicked to retrieve the key in 8 bwhose > arrowhead can access further keys and go back to the first key.If “Environment” is clicked on the topics list of 8 a or 8 b, thesubtopics list 8 c appears. If the down arrow to the right of “AnimalSpecies” is clicked on this list, subtopics list 8 d appears. If thedown arrow to the right of “Birds” is clicked on this list, subtopicslist 8 e appears. The retrieval bars at the top of the subtopics listsindicate how many levels down the current subtopic list is; the bars canbe clicked to move back up the hierarchy of lists. Clicking on theunderlined subtopic titles in a list will show and hide its special keyas shown in 8 f and 8 g. The retrieval bar at the bottom of the key in 8g and 8 h alphabetically retrieves features. The retrieval bar switchesfeatures lists by other means, in this case by Common or Latin name, bymonth of the sightings, and by showing either the Full Listing offeatures or those from any one of three queries.

FIGS. 9 a–d show examples of informational advertising integrated intothe present system. In FIG. 9 a, a pop-up flip-thru storybook appearswhen the viewer clicks a “Lodging” symbol on the map; clicking on thepop-up's index replaces the pop-up with new cards as shown below. Inanother form of integrated advertising, FIG. 9 b, the belowbar containsthe key for a special theme, “Walking Sydney,” while providing a“brought-to-you-by” message of the walking shoe sponsor and a link torelated product information and online ordering. Here the viewer hasclicked on the sponsor's message and a map has appeared showingavailable walking shoes appropriate to a set of sites. In FIG. 9 c, aslotting system is used in an online catalogue to present for comparisona category of products from many producers. In this case, when theviewer called forth the “Birds” subtopics under the “Environment” topic,a binocular distributor's special theme selector and message appeared;then when the word “info” was clicked, a slotted map of binocularsappeared. Clicking a slot calls up an informational pop-up. FIG. 9 dshows an interactive map-format report that plots information aboutviewers of ads that sponsored the world map illustrated in FIG. 7 a.When a user entered the map atlas site, an id number was assigned toreturn the proper map layers; this system is also useful as a marketanalysis tool. The user-tracking system records anonymous user-activitythat can be configured as such an interactive map-based report.

FIGS. 10 a and b show a variety of map displays derived from the samedatabase. The components of the graphical user-interface of the presentinvention are depicted as active regions on the screen of a User'sworkstation, 1. In this context, the system provides frame components,including Map area (a), message box and pop-up label (b1 & b2), rightcontrol panel (c), bottom control panel (d), left control panel (e),corner control panel (f), and finally the pop-up storybook (g). Aportion of a topical database is illustrated in 3; five examples of mapscreated from this same database are illustrated in 4–8 : exemplary useof the framework components are provided in the slotted map (4), layeredmap (5), slotted and layered graph map (6), gridded matrix and use ofpop-up storybook (7), and layered and slotted map with use of pop-upquery box (8) for selective display of information relating togardening. FIG. 11 shows an example of a three-dimensional model thatcan be rotated. With the addition of a topics list and key, it becomes a“map” and has feature and attribute data that can be shown and hidden,hilited, queried, and annotated.

Although the invention has been described in detail for the purpose ofillustration, it is to be understood that such detail is solely for thatpurpose and that variations can be made therein by those skilled in theart without departing from the spirit and scope of the invention.

What is claimed is:
 1. A data processing system of organizing,retrieving, and displaying data within a computer system to enablerepeated viewing of different, user-selected subsets of elements,comprising: a. a database and associated software for storing,organizing, and retrieving data about elements and their attributes; b.a display for displaying a visual representation of selected subsetelements for comparison, with:,
 1. each of the different, user-selectedsubsets given its own symbol, text, or common image format; and
 2. eachelement's symbol, text or image given a slot on the display; this slotmay be: i. designated by x, y, and z locations representing its real orsymbolic relationship to other elements; or ii. within a grid; and c. acontrol apparatus for showing and hiding subsets on the visualrepresentation which include display control panel(s) with selectorsthat, in response to user events or automatic updating systems, call tothe database to determine subset elements to be added and subtractedfrom the visual representation.
 2. The system of claim 1 wherein saidelements relate to an interactive two-dimensional, three-dimensional, orfour-dimensional map or diagram of a place, topic, or thing.
 3. Thesystem of claim 1 wherein said selected elements comprise informationforming a computer or online alternative to reference documents.
 4. Thesystem of claim 1 wherein said selected elements comprise informationforming a computer or online specialty store where consumers can ask tosee and compare all the available offerings for a particular category ofproduct from one or a multitude of manufacturers and distributors.
 5. Incombination in a program-controlled data-processing system forcontrolling an infrastructure for presenting a collection of userselected information elements to facilitate translation of complextopical data to an enhanced display format, comprising: a. displaycontrol panels for receiving user commands and implementing a selectivelayering of data in the form of graphics, text and/or images onto a basepresentation wherein said control panel includes control icons and/ortext lists for manipulating the content of said selective layers inaccord wit user defined objectives; b. a database comprising one or moredata elements for use in providing the substance to said layered data,wherein said data elements are located in an addressable memory in saiddatabase; c. a central display controller in communication wit saiddatabase and said control panel for interpreting commands received bysaid control panel and directing the placement of said data elements inaccordance with a pre-programmed hierarchy; and d. wherein said display,interconnected to said central display controller for receiving imagedata including a base image and one or more selected layers for visualperception by said user.
 6. The system of claim 5 wherein databasefurther comprises database elements for supporting slotted map data forincorporation into said image data on said display.
 7. The system ofclaim 5 wherein said display is a two-dimensional matrix of pixelelements characterizing said data elements.
 8. In combination in adisplay management system for displaying complex data elements with saidsystem comprising; a. a first database having a plurality of dataelements on a subject and its graphic information, said elements arestored in volatile memory and said first database capable of beingrefreshed with current data from a second database; b. a displayprocessor characterized by a controlling program that provides one ormore users with control icons on said display for selectively recallingcollections of data; c. a communication means for linking said firstdatabase with said second database to provide for refreshed dataelements therefrom; and d. a display for providing a multi-dimensionalpresentation of selected data element layers in accordance with usercommands and said program controlling logic.
 9. The system of claim 8wherein said communication means is a public access network.
 10. Thesystem of claim 8 wherein said control icons are further characterizedby descriptive text that is selectively displayed to enhance navigationand information display.